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VEHICLE SYSTEM 

Background Information 

The present invention is directed to a vehicle system for 
operation in a motor vehicle according to the definition of 
the species in the independent claim. 

5 Vehicle systems are known in the form of vehicle navigation 
systems which output driving directions for guiding a vehicle 
driver along a previously computed route to a destination in 
acoustic and/or visual form. To compute the travel route, the 
driver must previously input the destination via an operator 

10 interface of the vehicle navigation system. Since inputting 

the destination while driving causes considerable distraction 
from the traffic situation, it has been discussed to suppress 
the operation of the device, in particular destination input, 
while the vehicle is in motion (referred to hereinafter as the 

15 "speed lock function"). 

DE 199 52 857 CI describes a device for controlling vehicle 
components as a function of the driver's condition, in which 
the driver's condition is determined and the information to be 
displayed is filtered as a function thereof. Operation and 

2 0 control by the driver is thus improved and safety is enhanced 
because the driver is less distracted. This device limits the 
operation of a functionality of the electronic device as a 
function of the situation. For example, the destination input 
of a navigation device may not be used or a TV set may not be 

25 turned on during travel. Full use or partial functionality of 
an application of the electronic device may also be turned on 
or off as a function of the speed of travel. 

Older German patent application 102 55 435.8 (not a prior 
publication) describes a driver information system having an 
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operator control in which operation at a certain detected 
speed of the vehicle is at least limited, i.e., having the 
above-described speed lock function; however, this limitation 
may be at least partially cancelled if, for example, occupancy 
5 of the front -seat passenger seat has been determined by a seat 
belt fastener sensor or a weight sensor. This approach assumes 
that, in the case of an occupied front -seat passenger seat, 
the front -seat passenger actually operates the driver 
information system; however, operation by the vehicle driver 
10 is not ruled out. In practice, it has been found that, even if 
the front -seat passenger seat is occupied, the vehicle driver 
often assumes operation of the device. 

Advan t age s of t he I nvent i on 

15 The vehicle system according to the present invention having 

the features of the independent patent claim has the advantage 
over the related art that operation of the system is 
influenced depending on whether the vehicle driver or another 
occupant of the vehicle is accessing the vehicle system. 

2 0 Operating access which may excessively distract the vehicle 

driver from the actual driving task is thus effectively 
disabled. At the same time, the vehicle system remains fully, 
or at least largely, operational for other vehicle occupants. 
Operation is understood in the context of the present 
25 invention primarily as inputs by the operator into the vehicle 
system, but also as outputs of the vehicle system to the user. 

In the case of a navigation system, for example, the front - 
seat passenger may thus assume operation of the navigation 
system while the vehicle is in motion in particular. Operation 

3 0 during travel may be necessary, for example, if the travel 

route is modified manually due to traffic problems not taken 
into account when the route was computed or to errors in the 
navigation data material. 
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When traveling with a front -seat passenger, additional inputs 
are thus possible and unnecessary stops are avoided, which 
contributes to safety. The present invention provides for 
limitation of operation which goes beyond that of the 
5 conventional speed lock function in the case of operating 

access by the vehicle driver, in particular within the speed 
lock function, i.e., while the vehicle is in motion. 

In each case, the present invention increases user acceptance 
of the speed lock function and ensures a competitive 
10 advantage . 

Drawing 

Exemplary embodiments of the present invention are illustrated 
in the drawing and explained in greater detail below. 

Figure 1 shows a block diagram of the portion essential to the 
15 present invention of the vehicle system according to the 
present invention; 

Figure 2 shows a flow chart of the essential portion of a 
software program running in a controller of the vehicle 
system. 

20 Detailed Description of the Exemplary Embodiments 

The vehicle system according to the present invention is 
described in detail below using the example of a vehicle 
navigation system. This, however, does not mean that the 
present invention is limited to vehicle navigation systems. 
25 Rather, the present invention is also applicable to other 

vehicle systems such as car radios or a cell phone operated in 
a vehicle. 

Vehicle system 1 according to the present invention includes 
an input device 13 having control elements not depicted in 
30 detail in the figure, preferably momentary- contact switches 

and/or incremental rotary transducers, for inputting commands 
and/or operating parameters into vehicle system 1. In the case 
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of a vehicle navigation system, the above-described control 
elements, combined for example with a controller 12 of the 
navigation system, are used for inputting a destination for a 
subsequent route computation from the current location to the 
5 destination and subsequent navigation. In the case of a cell 
phone, the control elements are used, for example, for dialing 
a certain telephone number of a desired conversation partner 
or for answering an incoming telephone call. 

Vehicle navigation system 1 according to the present invention 
10 also includes an output device 14, which is preferably 

designed as a visual and/or acoustic output. In the case of a 
vehicle navigation system, output device 14, combined with the 
navigation device, is used for outputting driving directions 
to guide the vehicle driver in the form of spoken driving 
15 directions and/or directional arrows displayed on a display 
device. Alternatively or additionally, a map display may be 
provided, on which the computed route or a portion thereof is 
displayed to orient the driver. 

Furthermore, output device 14 combined with the destination 
20 input is used, for example, for displaying selectable 

destinations and/or a map display, on which a destination may 
be marked with the aid of a cursor operable via the control 
elements of input device 13 . 

In the case of a car radio, output device 14 includes, for 
25 example, the display of the car radio which, in addition to 
the name or the receiving frequency of a currently set 
broadcast station, displays variable information transmitted 
using the radio data system (RDS) such as title and performer 
of a song currently being transmitted or running text such as 
30 advertising, for example. 

Input device 13 and output device 14, both connected to 
controller 12, together form an operator control 15 of the 
vehicle system according to the present invention. 
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Means 11, designed for detecting whether the driver or another 
vehicle occupant is accessing operator control 15 of vehicle 
system 11, is also connected to controller 12 of the vehicle 
system according to the present invention and generates an 
5 appropriate access detection signal as a function of the 
person accessing the system. 

For this purpose, access detection means 11 includes sensors 
for detecting information on the basis of which it is possible 
to determine which of the vehicle occupants is accessing 
10 operator control 15 for operating vehicle system 1. 

In a first embodiment of the operator detection means, this 
sensor system includes a camera 115, whose imaging range 
includes at least driver seat (2) or the front -seat passenger 
seat (3) , but preferably both the driver and the front -seat 

15 passenger seats. The image information recorded by the camera 
is processed in a first software module 111 of controller 12 
and a signal is derived therefrom, which indicates whether 
driver 2 or front-seat passenger 3 is accessing operator 
control 15, in particular the control elements of input device 

20 13 . 

The exact mode of operation of first software module 111 for 
deriving one of the vehicle occupants accessing the system is 
not the object of the present invention and will therefore not 
be described in more detail. The principle involved is 

25 abundantly known from the literature. Reference is made to the 
overview article, D. M. Gavrila: "The Visual Analysis of Human 
Movement: A Survey" in Computer Vision an [d] Image 
Understanding, vol. 73, no. 1, January, pp. 82-98, 1999, in 
which approaches to this problem are described and to whose 

30 entire disclosure content regarding driver or front-seat 
passenger detection reference is hereby made. 

An image pattern comparison, for example, is suitable for this 
purpose, an image previously recorded and stored as part of 
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the software component, for example, of the hand or also the 
arm and possibly the upper body of the front -seat passenger 
accessing the system being used as a basis for the comparison. 
Alternatively, three-dimensional or other image detection 
5 algorithms may also be used. 

In the context of the present invention, it is only essential 
that first software component 111 is capable of using the 
image signals of camera 115 to unambiguously determine whether 
the hand of driver 2 or hand 31 of front -seat passenger 3 is 
10 accessing the control elements of input device 13 of vehicle 
system 1 . 

According to an advantageous variant of this first embodiment 
of access detection means 11, instead of a single camera 115 
at least two video sensors are provided at a distance from one 
15 another or a multicamera video sensor is provided. The stereo 
or multichannel image information detected by this sensor 
system allows three-dimensional detection of the driver or 
front -seat passenger seat, or the driver or front -seat 
passenger. 

2 0 According to a refinement of the first embodiment, the gray 

scale value information contained in the video signals is also 
analyzed for the purpose of access detection 11. 

According to another advantageous version of this first 
embodiment, access determination means (11) operates by the 
25 principle of depth sensors, which in the present case of a 

video sensor system are based on the principle of structured 
lighting . 

Both the evaluation of stereo or multichannel video 
information and the principle of structured lighting are 

3 0 described in detail in the related art and, for example, in X. 

Jiang "Dreidimensionales Computersehen" [Three-dimensional 
computer viewing] , Springer-Verlag, Berlin Heidelberg, to 
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which express reference is hereby made, so that a detailed 
explanation of these principles may be omitted here. 

A second embodiment of operator detection device 11 is based 
on the assumption that vehicle system 1 is at least partly, in 
5 particular with respect to its more complex operating 
functions, operated via spoken commands. At least one 
microphone 112 is required to detect the spoken commands. The 
microphone is situated within a hands- free device for a cell 
phone, preferably in front of the driver seat in or on the 

10 vehicle dashboard. At least one second microphone 113 which is 
installed spatially separated from first microphone 112, 
preferably in front of the front-seat passenger seat in the 
dashboard of the motor vehicle is provided for detecting 
whether the verbal commands have been given by vehicle driver 

15 2 or front-seat passenger 3. The signals of both the first and 
second microphone are supplied to first software component 111 
of controller 12, which uses the difference in propagation 
time between the signals of the first and second microphone, 
for example, via cross -correlation of the two microphone 

20 signals, to determine whether driver 2 or front -seat passenger 
3 has issued the verbal commands. This is made possible by the 
above -described location of microphones 112 and 113, because, 
for example, the commands issued by vehicle driver 2 to second 
microphone 113 need a longer propagation time than those 

25 issued to first microphone 112 situated in front of the 

driver. The same is true for the commands issued by front -seat 
passenger 3 . 

Additional embodiments of access detection means 11 is 
directed in particular to an alternative sensor system. 

30 The access detection means may thus also include a radar 

sensor system instead of the above-described sensor system. 

Access detection means 11 may also include a sensor system 
which operates and evaluates signals on the basis of a depth 
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sensor by the propagation time principle or the laser scanner 
principle . 

These alternative measuring and evaluation methods are also 
abundantly known from the related art, for example, from R. 
5 Schwarte et al . "New Powerful Sensory Tool in Automotive 

Safety Systems Based an PMD-Technology , " Advanced Microsystems 
for Automotive Applications 2000, Springer- Verlag, Berlin 
Heidelberg, 2000, to which publication reference is hereby 
expressly made, so that a detailed explanation of these 
10 principles may be omitted here. 

According to a first, simple embodiment of the operation 
control, the operation, i.e., operability of vehicle system 1 
is controlled on the basis of the detected operator, in 
particular driver 2 or other occupant 3 of the vehicle. For 

15 this purpose, controller 12 includes a second software 

component, which further processes the signal of operator 
detection means 11 and controls operator control 15, in 
particular the scope of its functions, on the basis thereof. 
The control of the operation of vehicle system 1 includes in 

20 particular limiting or enabling of operation functionalities 
as a function of the vehicle occupant operating the system. 
The vehicle driver may thus only have access to a limited 
operator interface, i.e., a limited scope of functions 13 and 
a limited selection of functions of operator guidance 14, 

25 while front-seat passenger 3 may access the entire range of 
operations of vehicle system 1. 

According to a preferred embodiment of the present invention, 
additional means 16 is provided in controller 12 of vehicle 
system 1 according to the present invention for generating at 
30 least one signal indicating the motion status, in particular 
motion as opposed to a standstill, of the motor vehicle. This 
may be a tacho signal generator 162, which generates a signal 
indicating the instantaneous vehicle velocity. In the case of 
a vehicle navigation system 1, means 16 may also include a GPS 
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receiver, which analyzes position data about the instantaneous 
vehicle position and derives a signal indicating the 
instantaneous motion status of the vehicle therefrom. 

The signals indicating the motion status of the vehicle, for 
5 example, the signals of tacho signal generator 162 are 

supplied to an analyzer 163, which is preferably designed as a 
component of the controller in the form of a third software 
routine. Analyzer 162 is designed to use the signals 
indicating the motion status of the vehicle to determine 
10 whether the vehicle is at a standstill, is moving, or is 
moving at a certain minimum velocity. 

Signal generator 162 and analyzer 161 form a device 16 for 
detecting motion of the vehicle. 

According to the preferred second embodiment of the operating 
15 control, which is based on the preferred embodiment of the 
vehicle system having motion detection device 16, the 
operation of vehicle system 1 is controlled as a function of 
both the vehicle's motion status and detected operator 2 or 3 
of vehicle system 1. 

2 0 This is explained below using the example of a vehicle 

navigation system in a motor vehicle, taking into account the 
flow chart of Figure 2 . 

A distinction is made between three states. 
1. Vehicle at a standstill 

25 On the basis of the motion data acquired by sensor system 162, 
motion detection means 16 detects that the vehicle is at a 
standstill (step 21 - alternative "no") . For this case, 
controller 12 enables operation of the full range of vehicle 
navigation system 1 (step 23) . This means that, for example, a 

30 destination, i.e., the name of the destination in particular 
and a corresponding street name, may be input via control 
elements of input device 13 of the navigation system, 
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inputting being supported by navigation system 1 via 
appropriate displays, for example, of proposed names, on 
display device 14, on the basis of input letters. 

2. Vehicle in motion, operating access by driver 2 

5 Motion detection means 16 uses the motion data detected by 
sensor system 162 to determine that the vehicle is in motion 
(step 21, alternative "yes") . Furthermore, the access 
detection means detects that the vehicle driver is accessing 
operator control 15 (step 22, alternative "yes"), i.e., the 

10 hand of driver 2 is in the area of input device 2 of vehicle 
navigation system 1, and a control element of vehicle 
navigation system 1 is being actuated. Alternatively, this 
access status may also be identified by the fact that a 
control element of input device 13 is operated and hand 31 of 

15 the front -seat passenger is not in the area of input device 13 
of the vehicle navigation system. 

In this case, controller 12 controls the functions of 
navigation system 1 in such a way that it restricts or 
simplifies the outputs directed at the vehicle driver by 
20 output device 14 to maximally reduce the distraction of 

vehicle driver 2 from the traffic situation. In the present 
example of the vehicle navigation system, for example, a map 
display having a route drawn in is replaced while the vehicle 
is in motion by the display of simple and easy- to-grasp turn 

2 5 arrows and by a simple verbal turn direction. Thus, in 

particular, complex directions such as "please turn left onto 
Hilderheimer Strasse in 500 m, please reduce speed, sharp 
curve" are replaced by shorter and easier- to-grasp directions 
such as "left now" or "next street on the left." 

3 0 Furthermore, controller 12 completely locks input device 13 of 

operator control 15 for inputs by driver 2, i.e., it 
implements the essentially known speed lock function as 
defined above (step 25) . 



NY01 1040811 vl 



10 



3. Vehicle in motion, operating access by front-seat passenger 
3 

Motion detection means 16 detects motion of the vehicle on the 
basis of the motion data detected by sensor system 162 (step 
5 21, alternative "yes"). Furthermore, access detection means 11 
determines that front -seat passenger 3 is accessing operator 
control 15 (step 22, alternative "no"), i.e., hand 31 of 
front-seat passenger 3 is in the area of input device 13 of 
vehicle navigation system 1, and a control element of vehicle 
10 navigation system 1 is being actuated. Alternatively, this 
access status may also be identified by the fact that a 
control element of input device 13 is being actuated and the 
hand of driver 2 is not in the area of input device 13 of 
vehicle navigation system 1. 

15 For this case, controller 12 allows at least a limited or, 
depending on the embodiment of the present invention, even 
full operability of vehicle system 1 (step 24) . In this case, 
i.e., with the vehicle in motion and operating access by 
front-seat passenger 3, controller 12 preferably enables all 

20 display possibilities and input procedures which are also 

enabled with the vehicle at a standstill, because these may be 
performed by front -seat passenger 3, who does not have to 
concentrate on driving the vehicle. However, the outputs 
intended primarily directly for the vehicle driver engaged in 

2 5 the task of driving are preferably output in a simple and 

therefore easy- to-grasp form as described previously. 

Alternatively (step 24) , the acoustic driving directions of 
navigation system 1 may also be output in an easy- to-grasp, 
abbreviated form here, whereas a detailed map with the route 

3 0 of travel drawn in appears on the display of the vehicle 

navigation system, so that it is able to be understood by the 
front -seat passenger, who then may impart explanatory or 
additional directions to the vehicle driver. Furthermore, this 



NY01 1040811 vl 



alternative allows the front-seat passenger to better 
understand and, if necessary, to correct the route. 

Furthermore, the range of operability for operating access by 
front -seat passenger 3 with the vehicle in motion may be 
5 individually settable. 

When separate output and/or input devices are available to the 
driver and the front -seat passenger, as is the case of 
individual entertainment systems for the backseat passengers, 
or when an additional display device is available, for 

10 example, in a combo instrument in addition to the display of 
the vehicle system provided in the center console, additional 
operating strategies may be advantageously provided. Thus, in 
the case of a vehicle in motion and operating access by front - 
seat passenger 3, simple directional arrows may be displayed, 

15 for example, to driver 2 by the additional display in the 

combo instrument for navigation, while a detailed map with the 
route drawn in is made available to the front -seat passenger 
on the display in the center console display or front seat 
head support. Furthermore, operation by front-seat passenger 3 

20. may be enabled by allowing the front -seat passenger to set any 
desired map detail or zoom factor via the input device, while 
only the directional arrows continue to be displayed to driver 
2 . 

Controller 12 thus achieves motion-dependent and operator- 
25 dependent control of the operation of vehicle system 1 by 
operator control 15. 
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